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SYSTEM AND METHOD FOR ORGANIZING TWO AND THREE DIMENSIONAL 

IMAGE DATA 

BACKGROUND OF THE INVENTION 

Technical Field of the Invention 

The present invention relates to handling graphic data, 
and particularly to a system and method for handling two and 
5 three dimensional data forming a picture image. 

Description of the Related Art 

Computer based control systems are known to present a 
visual display of an activity that is thereupon used to 
10 monitor or control that activity. Graphical pictures or 
images are commonly used to form a model of an activity or 
process. Traditionally, computer based control systems use 
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two dimensional models. Due to an increased need for 
providing a model having additional information so as to 
provide better control over a process, a two dimensional 
model is, in many instances, insufficient. 
5 In organizing and presenting a visual display of a 

picture, some prior and existing control systems have divided 
a picture image into a plurality of subpictures. One problem 
encountered is that the amount of data within the subpictures 
forming a picture image may vary considerably. Because 

10 system resources are taxed simply by loading and handling a 
subpicture for inclusion within a picture to be visually 
displayed, subpictures having both large and small amounts 
of data may adversely effect the overall performance of the 
control system. Based upon the foregoing, there is a need 

15 for more efficiently storing, retrieving and otherwise 
handling image data forming a picture . 

SUMMARY OF THE INVENTION 

The present invention overcomes the shortcomings in 
20 prior systems and thereby satisfies a significant need for 
a graphics system and method that more effectively organizes 
or otherwise handles data forming a two or three dimensional 
picture or image. According to an embodiment of the present 
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invention, the picture is divided into a number of 
subpictures, wherein subpictures having different resolutions 
are placed in different levels that are stacked in relation 
to each other. The picture is defined by a plurality of 
5 levels, each level including a plurality of subpicture areas 
corresponding to a different level of image data resolution 
relative to image data resolution levels corresponding to 
subpicture areas in other levels. The method and system 
include selecting a subpicture element having image data for 

10 inclusion in the picture image and identifying a subpicture 
area in which the subpicture element may be placed, the 
identified subpicture area being in the lowest possible level 
of the picture image . The method and system further include 
placing the image data of the subpicture element in the 

15 identified subpicture area. Upon a determination that the 
amount of image data in the identified subpicture area 
exceeds a predetermined maximum amount following the placing 
operation, the system and method identify overlapping 
subpicture areas in a level corresponding to the next higher 

20 image data resolution level that overlaps the identified 
subpicture area. Following the identifying operation, the 
system and method place image data of one or more subpicture 
elements from the identified subpicture into at least one of 
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the overlapping subpicture areas . By incorporating or 
otherwise adding a picture element into a picture structure 
in this manner, subpictures are better grouped for transport 
and storage within the system. 

5 

BRIEF DESCRIPTION OF THE DRAWINGS 

A more complete understanding of the system and method 
of the present invention may be obtained by reference to the 
following Detailed Description when taken in conjunction with 
10 the accompanying Drawings wherein: 

Figure 1 is a block diagram of a graphics system in 
accordance with an embodiment of the present invention; 

Figure 2 is a diagram illustrating the basic structure 
of a picture utilized by the graphics system of Figure 1; 
15 Figures 3 is a flow chart illustrating an operation of 

the graphics system of Figure 1; 

Figure 4 is another flow chart illustrating another 
operation of the graphics system of Figure 1; and 

Figure 5 is a portion of an alternative flow chart 
20 illustrating an alternative operation of the graphics system 
of Figure 1 . 
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DETAILED DESCRIPTION OF THE PREFERRED EXEMPLARY EMBODIMENTS 

The present invention will now be described more fully 
hereinafter with reference to the accompanying drawings in 
which a preferred embodiment of the invention is shown. This 
5 invention may, however, be embodied in many different forms 
and should not be construed as being limited to the 
embodiment set forth herein. Rather, the embodiment is 
provided so that this disclosure will be thorough and 
complete, and will fully convey the scope of the invention 

10 to those skilled in the art. 

Referring to Figure 1, there is shown a graphics system 
1 for displaying or otherwise handling two or three 
dimensional data. For reasons of simplicity and in 
accordance with an embodiment of the present invention, 

15 graphics system 1 will be described as part of an industrial 
or process control system. In such a system, graphical 
picture images are generated to provide a model, such as a 
geographical or schematic model of the process being 
controlled. It is understood, however, that graphics system 

2 0 1 may be other types of systems for handling and displaying 
graphical data. 

According to the disclosed embodiment of the present 
invention, graphics system 1 includes a processor 2 that is 
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capable of performing a number of operations for retrieving 
and processing graphics information. For example, processor 
2 may be a microprocessor commonly found in a personal 
computer . 

5 Graphics system 1 further includes memory 3 coupled to 

processor 2 and having stored therein software code for 
allowing processor 2 to, among other operations, receive and 
process graphics data for visual display. Memory 3 may be 
further capable of storing the graphics data. Graphics 

10 system 1 may further include a secondary memory device (not 
shown) . The software code instructions stored in memory 3 
and the operations performed by processor 2 will be described 
in greater detail below. 

Graphics system 1 further includes a display device 4 

15 coupled to processor 2 for displaying graphics data. The 
graphics data may be two or three dimensional data. It is 
understood that graphics system 1 includes user controls for, 
among other things, controlling the image of graphics 
information. 

2 0 In general terms, graphics system 1 organizes graphics 

data forming a picture image so as to substantially optimize 
graphics data retrieved from memory 3 for presentation on 
display device 4. Graphics system 1 divides the graphics 
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data forming a picture image into a plurality of subpictures . 
The subpicture grids are disposed onto a plurality of levels 
of differing resolution levels that are arranged in a stacked 
relationship. By placing image data within these subpictures 
5 in accordance with a predetermined algorithm, each subpicture 
is sized within a predetermined size range so as to 
substantially minimize the amount of data transported between 
processor 2, memory 3 and display device 4. 

At this point, image related terms will be defined with 

10 reference to Figure 2. A "picture image" and/or "picture" 
2 0 is defined as an independent set of related coordinate 
based image data that provides a model of a dynamic process, 
such as a process being controlled in part by graphics system 
1. An "extent" refers to a dataset position in coordinate 

15 space having a coordinate position and a size or dimension 
in coordinate directions surrounding or otherwise in 
proximity to the coordinate position. An "element" is 
defined as a set of image data belonging to a picture image 
2 0 having a common extent and lacking any other reference to 

20 other parts of picture image 20. A "subpicture" 21 refers 
to a portion of picture image 20 and is itself a picture 
limited to elements from a portion of the coordinate space 
encompassed by picture 20. A subpicture 21 may be classified 

Dallas2 72491 1 v 1 , 45060.00002 7 



Patent Application 
Docket No. 45060-2 



as being 1) "uninstantiated" when no data structures for the 
subpicture exist; 2) "instantiated" when a data structure of 
the subpicture 21 exists; and 3) "loaded" when an 
instantiated data structure for subpicture 21 and elements 
5 are transferred from secondary memory to memory 3 . 

In addition, a subpicture 21 has "overflowed" when the 
amount of image data therein exceeds a predetermined maximum 
amount. For example, the predetermined maximum amount may 
be 1000 elements. A subpicture 21 is uninstantiated if the 

10 amount of image data therein is less than a predetermined 
minimum amount. For example, the predetermined minimum 
amount may be ten elements . 

A "level" 22 (Figure 2) is defined as a set of 
subpictures 21 having an amount of image data resolution that 

15 is different from the amount of image data resolution at 
other levels. All subpictures 21 in the level 22 together 
cover the entire coordinate space of picture image 20 and do 
not overlap. Each level 22 has a unique characteristic that 
may be utilized together extent to distribute elements among 

20 the subpictures 21. For example, a characteristic of a level 
22 may be a zoom level or z-coordinate . 

Further, a "picture scheme" is a complete organizational 
description of all subpictures 21 forming a picture 20. A 
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picture scheme is "exhausted" when the subpicture structure 
of the picture scheme overflows with elements of image data. 

An element "fits" within a subpicture 21 if the 
element ! s extent is substantially entirely within the extent 
5 of the subpicture 21. The level definition of an element is 
consistent with the level characteristics of the 
corresponding level 22. 

The described embodiment of the present invention is 
directed towards organizing or otherwise handling image data 

10 so as to substantially optimize the storage and transport of 
the image data between processor 2, memory 3 and display 
device 4. In particular, the handling of an element 
corresponding to a picture will be described with reference 
to Figures 3 and 4 . 

15 Initially, graphics system 1 defines or is provided with 

a picture scheme at step 31 for handling image data for 
forming a picture 2. In this case, the picture scheme 
defines picture 20 as having four levels 22A-22D of 
subpictures 21, as shown in Figure 2. The picture scheme 

20 defines the uppermost level 22A as having a single subpicture 
21 with a low level of resolution, with each level below 
level 22A having an increasing number of subpictures and a 
higher level of resolution. 
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Upon receiving an element corresponding to picture 20 
at step 32, processor 2 identifies at step 33 a subpicture 
21 in the lowest most level 22 in which the received element 
may fit. The identified subpicture 21 is loaded if the 
5 identified subpicture 21 has not yet been loaded. The 
received element is then placed in the identified subpicture 
21 at step 34. 

At this point, graphics system 1 operates to divide the 
image data amongst the subpictures 21 so as to improve data 

10 transport within graphics system 1. If the number of 
elements now within identified subpicture 21 is less than the 
predetermined maximum amount, the inclusion of the received 
element into and/or within picture 2 0 is complete. On the 
other hand, if the number of elements now within identified 

15 subpicture 21 exceeds the predetermined maximum amount, 
graphics system 1 then determines at step 35 whether the 
identified subpicture 21 is at the lowest level 22 of picture 
20. Upon the determination that the identified subpicture 
21 is at the lowest level 22 of picture 20, the picture 

20 scheme is exhausted and a routine for redefining the picture 
scheme is initiated at step 36. This routine will be 
described in detail below. Upon the determination that the 
identified subpicture 21 is not at the lowest most level 22, 
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graphics system 1 identifies at step 37 all of the 
overlapping subpictures 21 in the next lower level 22 having 
extents which overlap extents of the identified subpicture 
21. If no such overlapping subpictures 21 are identified, 
5 the routine for redefining the picture scheme is initiated. 
Otherwise, graphics system 1 then sorts at step 38 the 
overlapping subpictures 21 in a list of overlapping 
subpictures in descending order of the number of elements 
that the overlapping subpictures 21 may receive from the 

10 identified subpicture 21, with respect to extent and level. 

Thereafter, graphics system 1 examines each overlapping 
subpicture 21 sequentially, starting with the overlapping 
subpicture 21 at the top of the list and examining each 
overlapping subpicture 21 in descending order. For each 

15 overlapping subpicture 21 examined, graphics system 1 first 
determines at step 40 whether the corresponding number of 
overlapping elements that the overlapping subpicture 21 may 
receive from the identified subpicture 21 is greater than the 
predetermined minimum number of elements. If not, the 

2 0 picture scheme is exhausted and the routine for redefining 
the picture scheme is initiated. Otherwise, the examined 
overlapping subpicture 21 is added to a "subpicture to 
instantiate" list at step 41. A determination is made at 
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step 42 whether the number of elements that would remain in 
the identified subpicture 21 less the corresponding number 
of overlapping elements is less than the predetermined 
maximum amount of elements in a subpicture. If the number 
5 of remaining elements still exceeds the predetermined maximum 
amount, then the next overlapping subpicture 21 in the list 
is examined and steps 40-41 repeated therefor. If there are 
no more overlapping subpictures 21 in the list, picture 
scheme is exhausted and the routine for redefining the 

10 picture scheme is initiated. 

If the number of remaining elements is less than the 
predetermined maximum amount of elements, graphics system 1 
sequentially removes each overlapping subpicture 21 from the 
"subpicture to instantiate" list and instantiates each at 

15 step 43. For each instantiated overlapping subpicture 21, 
graphic system 1 identifies all of the instantiated 
subpictures 21 appearing on the next higher level 22 having 
an extent that overlaps the instantiated overlapping 
subpicture 21 at step 44, moves all elements from the 

20 identified instantiated subpictures 21 from step 44 into the 
instantiated overlapping subpicture 21 at step 45, and 
returns to step 35 if the number of elements in the 
particular instantiated overlapping subpicture 21 exceeds the 
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predetermined maximum amount of elements. When steps 44 and 
45 have been performed for all of the overlapping subpictures 
21 in the "subpicture to instantiate" list, the incorporation 
of the received element into picture 20 is complete. 
5 The routine for redefining the picture scheme, executed 

upon a determination that the picture scheme is exhausted, 
will be described with reference to Figure 4. The 
"subpictures to instantiate" list and the "overlapping 
subpicture" list are cleared at step 50, Next, graphics 

10 system 1 loads in step 51 all of the instantiated subpictures 
21 in picture 20 that have not yet been instantiated. All 
of the elements from the instantiated subpictures 21 are 
extracted and added to a "total" list in step 52. Picture 
20 and the corresponding picture scheme are then deleted in 

15 step 53. A new picture 20 and picture scheme are then 
received and instantiated together with the uninstantiated 
subpictures 21 at step 54. The elements appearing in the 
"total" list are then successively added to the new picture 
20 using the operation illustrated in Figure 3. Thereafter, 

20 the received element (step 32) has been successively 
incorporated within picture 2 0 and particularly within a 
particular subpicture 21 of picture 20. 
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As can be seen, the operation shown in Figure 3 results 
in the same distribution of elements within picture 20 
regardless of the order in which the elements are 
incorporated in picture 20. Instead of steps 38-45, an 
5 alternative embodiment may include the steps of determining 
the number of elements each overlapping subpicture 21 may- 
receive from the identified subpicture 21 at step 60 with 
respect to extent and level (Figure 6) , and instantiating 
each overlapping subpicture 21 having the most receivable 

10 elements at step 61. In the event the number of elements 
corresponding to the overlapping subpicture 2 capable of 
receiving the greatest number of elements is not greater than 
the predetermined minimum number of elements, the picture 
scheme is exhausted and the routine of Figure 4 is performed. 

15 If not, the elements from the identified subpicture 21 that 
fit within the instantiated, overlapping subpicture 2 of step 
61 that fit therein at step 62. Steps 61 and 62 are repeated 
for each overlapping substructure 21 • 

The invention being thus described, it will be obvious 

20 that the same may be varied in many ways. Such variations 
are not to be regarded as a departure from the spirit and 
scope of the invention, and all such modifications as would 
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be obvious to one skilled in the art are intended to be 
included within the scope of the following claims. 
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